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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

In re Patent Application of 

COWAN et al Atty. Ref.: 3652-33 

Serial No. Unassigned Group: 

Filed: March 6, 2001 Examiner: 

For: METHOD AND SYSTEM FOR MEASURING CHARACTERISTICS OF AN ORGAN 



March 6, 2001 



Assistant Commissioner for Patents 
Washington, DC 20231 

Sir: 

AMENDMENT 

Please amend the above application as follows: 



IN THE CLAIMS 



Please substitute the following amended claims for corresponding claims 
previously presented. A copy of the amended claims showing current revisions is 
attached. 

5. (Amended) A method as claimed in claim 1 comprising the steps of 
displaying one or more images to a user and superimposing on the image a 
representation of the intersection of the reference model with the image. 
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7. (Amended) A method as claimed in claim 5 wherein the user 
performs the step of defining one or more boundary points on the image(s). 

8. (Amended) A method as claimed in claim 5 further comprising the 
step of calculating the volume of the subject organ or part from the estimate 
model. 

9. (Amended) A method as claimed in claim 5 further comprising the 
step of calculating the mass of the subject organ or part from the estimate 
model. 

10. (Amended) A method as claimed in claim 5 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular mass, endocardial volume and/or wall thickness of all of the ventricle 
or part thereof. 

11. (Amended) A method as claimed in claim 5 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular abnormalities identified through changes in wall thickness over time. 

12. (Amended) A method as claimed in claim 1 wherein the subject 
organ comprises a kidney and the characteristics measured include cortical 
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thickness. 

17. (Amended) A system as claimed in claim 13 further comprising 
display means arranged to display one or more images to a user and to 
superimpose on the image a representation of the intersection of the reference 
model with the image slice. 

19. (Amended) A system as claimed in claim 17 wherein the boundary 
guide point definition means is arranged to obtain preferred guide point positions 
from a user. 

20. (Amended) A system as claimed in claim 17 further comprising 
volume calculation means arranged to calculate the volume of the subject organ 
or part from the estimate model. 

21. (Amended) A system as claimed in claim 17 further comprising 
mass calculation means arranged to calculate the mass of the subject organ or 
part from the estimate model. 

22. (Amended) A system as claimed in claim 17 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular mass, endocardial volume and/or wall thickness of all of the ventricle 
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or part thereof. 

23. (Amended) A system as claimed in claim 17 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular abnormalities identified through changes in wall thickness over time. 

24. (Amended) A system as claimed in claim 17 wherein the subject 
organ comprises a kidney and the characteristics measured include cortical 
thickness. 

29. A program as claimed in claim 25 further comprising display means 
arranged to display one or more images to a user and to superimpose on the 
image a representation of the intersection of the reference model with the image. 

31. (Amended) A program as claimed in claim 29 wherein the boundary 
guide point definition means is arranged to obtain preferred guide point positions 
from a user. 

32. (Amended) A program as claimed in claim 29 further comprising 
volume calculation means arranged to calculate the volume of the subject organ 
or part from the estimate model. 
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33. A program as claimed in claim 29 further comprising mass 
calculation means arranged to calculate the mass of the subject organ or part 
from the estimate model. 

34. (Amended) A program as claimed in claim 29 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular mass, endocardial volume and! or wall thickness of all of the ventricle 
or part thereof. 

35. (Amended) A program as claimed in claim 29 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular abnormalities identified through changes in wall thickness over time, 

36. (Amended) A program as claimed in claim 29 wherein the subject 
organ comprises a kidney and the characteristics measured include cortical 
thickness. 

37. (Amended) A computer program as claimed in claim 25 embodied 
on a computer readable medium. 
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REMARKS 



The above amendments have been made to place the application in a more 
traditional format. 

Attached hereto is a marked-up version of the changes made to the 
specification and claims by the current amendment. The attached page/s is/are 
captioned " Version With Markings To Show Chansfes Made . " 



LCM:lks 

1100 North Glebe Road, 8th Floor 
Arlington, VA 22201-4714 
Telephone: (703) 816-4000 
Facsimile: (703)816-4100 



Respectfully submitted 



NIXON &VANDERHYE P.C. 
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VERSION WITH MARKINGS TO SHOW CHANGES MADE 



IN THE CLAIMS 

5. (Amended) A method as claimed in [any one of the preceding 
claims] claim 1 comprising the steps of displaying one or more images to a user 
and superimposing on the image a representation of the intersection of the 
reference model with the image. 

7. (Amended) A method as claimed in claim 5 [or claim 6] wherein the 
user performs the step of defining one or more boundary points on the image(s). 

8. (Amended) A method as claimed in [any one of the preceding 
claims] claim 5 further comprising the step of calculating the volume of the 
subject organ or part from the estimate model. 

9. (Amended) A method as claimed in [any one of the preceding 
claims] claim 5 further comprising the step of calculating the mass of the subject 
organ or part from the estimate model. 

10. (Amended) A method as claimed in [any one of the preceding 
claims] claim 5 wherein the subject organ comprises a ventricle of the heart and 
the characteristics measured include ventricular mass, endocardial volume 
and/or wall thickness of all of the ventricle or part thereof. 
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11. (Amended) A method as claimed in [any one of the preceding 
claims] claim 5 wherein the subject organ comprises a ventricle of the heart and 
the characteristics measured include ventricular abnormalities identified through 
changes in wall thickness over time. 

12. (Amended) A method as claimed in [any one of claims 1 to 9" claim 
i wherein the subject organ comprises a kidney and the characteristics measured 
include cortical thickness. 

17. (Amended) A system as claimed in [any one of claims 13 to 16] 
claim 13 further comprising display means arranged to display one or more 
images to a user and to superimpose on the image a representation of the 
intersection of the reference model with the image slice. 

19. (Amended) A system as claimed in claim 17 [or claim 18] wherein 
the boundary guide point definition means is arranged to obtain preferred guide 
point positions from a user. 

20. (Amended) A system as claimed in [any one of claims 13 to 19 
claim 17 further comprising volume calculation means arranged to calculate the 
volume of the subject organ or part from the estimate model. 



-8- 



504618 



COWAN et al 

Serial No. Unassigned 

21. (Amended) A system as claimed in [any one of claims 13 to 20] 
claim 17 further comprising mass calculation means arranged to calculate the 
mass of the subject organ or part from the estimate model. 

22. (Amended) A system as claimed in [any one of claims 13 to 21] 
claim 17 wherein the subject organ comprises a ventricle of the heart and the 
characteristics measured include ventricular mass, endocardial volume and/or 
wall thickness of all of the ventricle or part thereof. 

23. (Amended) A system as claimed in [any one of claims 13 to 22] 
claim 17 wherein the subject organ comprises a ventricle of the heart and the 
characteristics measured include ventricular abnormalities identified through 
changes in wall thickness over time. 

24. (Amended) A system as claimed in [any one of claims 13 to 21] 
claim 17 wherein the subject organ comprises a kidney and the characteristics 
measured include cortical thickness. 

29. A program as claimed in [any one of claims 25 to 28] claim 25 
further comprising display means arranged to display one or more images to a 
user and to superimpose on the image a representation of the intersection of the 
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reference model with the image. 

31. (Amended) A program as claimed in claim 29 [or claim 30] wherein 
the boundary guide point definition means is arranged to obtain preferred guide 
point positions from a user. 

32. (Amended) A program as claimed in [any one of claims 25 to 31] 
claim 29 further comprising volume calculation means arranged to calculate the 
volume of the subject organ or part from the estimate model. 

33. A program as claimed in [any one of claims 25 to 32] claim 29 
further comprising mass calculation means arranged to calculate the mass of the 
subject organ or part from the estimate model. 

34. (Amended) A program as claimed in [any one of claims 25 to 33] 
claim 29 wherein the subject organ comprises a ventricle of the heart and the 
characteristics measured include ventricular mass, endocardial volume and! or 
wall thickness of all of the ventricle or part thereof. 

35. (Amended) A program as claimed in [any one of claims 25 to 34] 
claim 29 wherein the subject organ comprises a ventricle of the heart and the 
characteristics measured include ventricular abnormalities identified through 
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changes in wall thickness overtinne. 

36. (Amended) A program as claimed in [any one of claims 25-33] claim 
29 wherein the subject organ comprises a kidney and the characteristics 
measured include cortical thickness. 

37. (Amended) A computer program as claimed in [any one of claims 25 
to 33] claim 25 embodied on a computer readable medium. 
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MET HOD AW B_SXSTE3S010gEASURI NG CHARACTERISTICS OF AN QRGAJ jL. 
FIELD OF THE INVENTION 

5 The invention relates to a method and system of measuring characteristics of an 
organ or part thereof. The method and system of the invention are particularly suited 
to measuring cardiac function, volume, and/ or mass of a ventricle of the heart of a 
subject from multiple image slices obtained by magnetic resonance imaging (MRI). 
The method and system of the invention may also be used to calculate the volume 
10 and/ or mass and other characteristics of other organs such as a lung, kidney or 
brain, to measure the position of the wall of a blood vessel for the purposes of 
analysis of flow, or to calculate the volume and/ or mass of a bone, tumour or cyst. 

15 BACKGROUND TO INVENTION 

Ventricular mass, volumes and wall thickness at end diastole and end systole are 
essential clinical parameters for diagnosis and management of many cardiac 
diseases. Magnetic resonance imaging (MRI) may be used to estimate heart wall 
20 motion by reconstructing the shape and motion of the left ventricle. 

MRI is also able to provide accurate and precise estimations of ventricular mass, 
volume and wall thickness, since it is a true S-dimensional method which is not 
dependent on geometric assumptions and is not limited in the position or orientation 
25 of the possible images, unlike other methods, such as for example echocardiography 
or computed tomography. 

Recent advances in MRI allow the acquisition of 10 to 20 MRI images or sHces in 
short and long axis or arbitrary orientations, each with 10 to 25 frames through the 
30 cardiac cycle in real time, or ten to fifteen minutes or less, which is a clinically 
acceptable time. Previous studies have shown that the summation of areas outlined 
in short axis MRI slices gives more accurate and reproducible estimates of volume 
than echocardiography or LV angiography. 

35 A major limitation of the MRI sKce summation method is the prohibitive time 
required to outline the endocardial and epicardial boundaries of the left ventricle in 
each slice. This severely limits application of the use of the technique to routine 
clinical care. 
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In the past, many semi- automated image segmentation algorithms have been applied 
to this problem, but these solutions are frequently not sufficiently robust and 
accurate for routine clinical use. In particular the image pixel intensities are 
5 insufficient to adequately constrain the segmentation problem, due to the limited 
temporal and spatial resolution, presence of image artifacts, and lack of contrast 
between blood and muscle. The amount of time spent on manual editing and 
correction of contours obtained from these previous solutions renders automated 
methods nearly as slow as manual contouring in clinical practice. 

10 

Other techniques apply model fitting techniques to estimate characteristics of organs 
such as the left ventricle. T Mclnemey and D Terzopoulos in "A Dynamic Finite 
Element Surface Model for Segmentation and Tracking in Multidimensional Medical 
Images with Application to Cardiac 4D Image Analysis", Computerized Medical 

15 Imaging and Graphics 19:69-83; 1995 describe a deformable "balloon'' model that is 
topologically isomorphic to a sphere for use in estimating volume and motion of the 
left ventricle. PCT international patent publication WO 99/ 18450 to Philips AB titled 
"Method of and Device for Imaging an Object by means of Magnetic Resonance" 
describes the use of an ellipsoid to model the left ventricle. Both techniques require 

20 the use of edge detection algorithms and in doing so suffer from the disadvantages 
discussed above. 

SUMMARY OF INVENTION 

25 In broad terms in one aspect the invention comprises a method of measuring 
characteristics of an organ or part thereof of a subject from multiple images of the 
subject's organ or part thereof, the method comprising the steps of defining the 
spatial position of at least two of the slices; defining a reference model of the organ or 
part thereof scaled according to the distance between the slices; defining one or more 

30 boundary guide points associated with one or more slices for which the spatial 
positions have been defined; converting the guide points to three-dimensional 
coordinates; defining an estimate model by fitting the reference model to the guide 
points; and calculating the characteristics from the estimate model. 

35 In broad terms in another aspect, the invention comprises a system for measuring 
characteristics of an organ or part thereof of a subject from multiple image slices of 
the subject's organ or part thereof, the system comprising a memory in which is 
stored the spatial position of at least two of the slices; reference model definition 
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means arranged to define a reference raodel of the organ or part thereof scaled 
according to the distance between the slices; boundary guide point definition means 
arranged to define one or more boundary guide points associated with one or more 
slices for which the spatial positions are stored in the memory; conversion means 
5 arranged to convert the guide points to three-dimensional coordinates; estimate 
model definition means arranged to define an estimate model by fitting the reference 
model to the guide points; and calculation means arranged to calculate the 
characteristics from the estimate modeL 

10 In yet another form the invention comprises a computer program for measuring 
characteristics of an organ or part thereof of a subject from multiple image slices of 
the subject's organ or part thereof, the program comprising storage means arranged 
to store the spatial position of at least two of the slices; reference model definition 
means arranged to define a reference model of the organ or part thereof scaled 

1 5 according to the distance between the sHces; boundary guide point definition means 
arranged to define one or more boundary guide points associated with one or more 
slices for which the spatial positions are stored in the memory; conversion means 
arranged to convert the guide points to three-dimensional coordinates; estimate 
model definition means arranged to define an estimate model by fitting the reference 

20 model to the guide points; and calculation means arranged to calculate the 
characteristics from the estimate model. 

BRIEF DESCRIPTION OF THE FIGURES 

25 Preferred forms of the invention will now be described, by way of example, with 
reference to the accompan3dng figures in which: 

Figure 1 is a flow chart outlining a preferred form of the method of the invention; 

30 Figure 2 shows the main window of a preferred form of an application program in 
which the invention is implemented; 

Figure 3 shows a guide points window and the preferred method of selecting the left 
ventricular basal slice from this window; 

35 

Figure 4 shows the preferred method of selecting the left ventricular apical slice from 
the window of Figure 3; 
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Figure 5 shows the preferred method of entering characteristics of the right ventricle 
from the window of Figure 3 ; 

Figure 6 shows the preferred method of defining the base or mitral valve plane from 
5 the window of Figure 3 ; 

Figures 7 to 10 illustrate a method of selecting boundary guide points from the 
window of Figure 3; 

10 Figures 1 1 and 12 show a preferred window for viewing the model; and 

Figures 13 to 15 show preferred displays of data obtained from the method and 
system of the invention. 

15 DETAILED DESCRIPTION OF PREFERRED FORMS 

Figure 1 sets out a preferred form of method of the invention. 

A number of images are first obtained of the left ventricle of a subject as indicated at 
20 1 10 . The images could be acquired from an MRI scanner, or may alternatively be 
acquired by an ultra-fast CT, 3-dimensional ultrasound machine or 
echocardiography , or other suitable imaging modality. The images could also be 
obtained from confocal microscopy, electron microscopy or histology. The images are 
typically 2-dimensional cines or movies of the heart and are taken at standard 
25 orientations, for example, short axis and long axis, or at entirely arbitrary positions 
depending on the nature of the pathology and imaging modality. 

The preferred images are acquired in a number of spatial locations, having a lowest 
or apical slice, a highest or basal sUce, one or more middle slices and one or more 
30 long axis slices. The preferred images are acquired in between 2 and preferably 20 
spatial locations, and t3?pically 12 spatial locations. Preferably images in each of 
these spatial locations are obtained at multiple frames through the cardiac cycle. 
The preferred number of frames is 10 to 25. 

35 Conventional MRI imaging apparatus produces images having image headers. The 
image header in each image generally comprises an extensive data Hst including 
patient name and scan parameters at the beginning of each image. The image 
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header also provides data representing the spatial position and temporal position of 
each slice or frame. 

The images are loaded into memory as indicated at 1 12. The preferred memory forms 
5 part of a computer having a CPU, input devices and a display device such as a VDU. 
The preferred input devices comprise a keyboard, mouse and disk drive, typically a 
networked magneto- optical disc drive and/ or CD ROM drive. Images may also be 
transferred over a network. The preferred memory comprises a hard disk drive 
suitable for storing the images. 

10 

The preferred computer comprises a SUN SparcStation, SGI work station, PC, or 
similar having at least 128 MB Ram or similar. The computer has loaded on it 
suitable operating system software, such as SOLARIS, IRIX, WINDOWS or LINUX. 
The preferred computer is arranged to execute application software in which the 
15 present invention has been developed. The preferred application software is written 
in C++, using OpenGL, Openlnventor and Xwindows for graphical interfaces. 

Referring to Figure 2, the user is presented with a main window from which a 
number of options may be selected. The option to load planes is indicated at 14 
20 which loads the three-dimensional position of the images and the option to load 
frames is indicated at 15 which loads the position of the images in time. This spatial 
and temporal information is generally included in the image headers. The option to 
load images is indicated at 16, Each separate image location is displayed in a 
second window at the first phase of imaging simultaneously. 

25 

Various parameters may be specified by the user at the time of loading the images, 
for example Model Type, Fit Type and Data Set, The user may also specify directoiy 
names for directories such as a Data Directory, a Model Directory and a Script 
Directory, 

30 

As shown at 114 in Figure 1, the next step is to define a three-dimensional co- 
ordinate system from two or more of the sUces for which the spatial positions have 
been defined. The main window of Figure 2 presents to the user an option to enter 
the guide points editor. The guide points editor loads the editor window shown in 
35 Figure 3. The editor window includes panel 20 which in the preferred form displays 
thumbnail images of the images stored in the memory. Panel 22 displays an 
enlarged image of one of the images displayed in panel 20. The preferred form 
window shown in Figure 3 also provides the user with the ability to zoom and pan 



172770 5 

images and to adjust brightness and contrast. The user may select the image to be 
displayed in panel 22 by, for example, clicking on one of the thumbnails displayed in 
panel 20. 

5 The user first selects the basal or highest short axis slice in panel 20, clicking on the 
thumbnail image to display the enlarged image in panel 22. In Figure 3 the user has 
selected the basal slice which is described below panel 22 as the seventh short axis 
image obtained during the first time interval or frame. 

10 The user selects the Base option indicated at 24. A prompt is displayed for the user 
to pick a point to represent the base in the model's cardiac coordinate system. The 
user selects a point in the centre of the ventricular image by clicking in panel 22. 
Once the desired base has been selected the user selects the option to accept the 
base indicated at 26. 

15 

Referring to Figure 4, the user repeats the procedure to select the apex of the object. 
The user selects the Apex option indicated at 28. A prompt is displayed for the user 
to pick a point representing the apex and the user then selects the point in panel 22. 
Once the desired apex has been selected the user accepts the apex as indicated at 
20 30. 

If the spatial position of the basal slice and the apical sUce is known then land marks 
may be determined, for example the long axis. The software calculates the length 
and position of the long axis by defining a line in 3-dimensional space between the 
25 two points selected by the user. 

As shown in Figure 5, the user is not limited to defining the co-ordinate system on 
the left ventricle. By selecting the option indicated at 35 the user may select 
different points or landmarks to analyse, for example, the right ventricle, 

30 

As shown in Figure 6, the user may display in panel 22 an image taken of the long 
axis of the object, as indicated by the description below panel 22. The user selects 
the Base Points option 32 which then prompts the user to choose two or more points 
on the image to define the maximum extent for estimate model and calculate 
35 volumes of, for example, the mitral valve plane. The user selects the points by 
clicking in panel 22 and once the desired points have been selected the user accepts 
the base points indicated at 34. Further options may also be provided, for example 
advancing the image displayed in panel 22 to the next frame. 
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It will be appreciated that the user does not need to define the axis by selecting the 
centre of the ventricle in the basal and apical slices. The user may instead define the 
centre of the left ventricle in two slices which are not the basal or apical slices. The 
5 software may then calculate the position of the long axis by defining a line in 3- 
dimensional space between these two points. The length of the long axis of the left 
ventricle may then be calculated separately from the distance between the basal and 
apical slices if the spatial position of the slices is known. 

10 As shown at step 116 in Figure 1, the software defines a reference model of a left 
ventricle. The preferred reference shape closely approximates the generic shape of a 
left ventricle. The reference model may be constructed from real patient data, but 
does not have to be absolutely accurate in terms of an individual patient. The 
reference model may be defined as an anal3^tical function, as a coordinate system, or 

15 as data points. 

The preferred reference model is a finite element model consisting of at least 16 
elements, typically 16 to 40, each with cubic interpolation in the circumferential and 
longitudinal directions. Linear interpolation is used to couple the endocardial and 

20 epicardial surfaces into a coherent 3-D model. The preferred model is defined in a 
polar coordinate system in which the radial coordinate of the model is fitted as a 
function of the two angular coordinates in the circumferential and longitudinal 
directions respectively. The preferred initial shape of the reference model is a regular 
ellipsoid, typically a prolate spheroid, obtained by setting the endocardial and 

25 epicardial surfaces to a constant radial value. The preferred reference model is 
scaled according to the length of the long axis of the left ventricle of the subject with 
the extent of the model in the longitudinal direction set to correspond to the point 
identified on the most basal slice of the left ventricle in the long axis. 

30 The preferred estimate model is obtained by a least squares finite element modelling 
process in which the left ventricle is divided into a number of rectangular segments 
or elements. Each element defines a bicubic spline surface for part of the 
endocardial and epicardial surfaces of the left ventricle. It is important to ensure 
continuity in the surface defined by adjacent elements. To ensure continuity, 

35 adjacent elements are constrained to have the same position and slope on each side 
of the join. Ensuring continuity in this way eliminates or at least reduces ridges and 
sharp transitions between adjacent elements. 
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Within each element, the geometric coordinate field x is given as a function of 
element or material coordinates ^ by a weighted average of nodal values: 

5 X(^,,|„^3)=X^»('^l'<^2'^3U" (1) 

n 

where are the nodal values, are the element basis functions which give the relative 
weighting of each nodal value, and (^^,^^,^-^) are the element co-ordinates. 

10 The geometric field A is defined to be the radial co-ordinates in the polate spheroidal co- 
ordinate system: 

X = /cosh(jl)cos(/i) 

y = /smh(A)sin(^)cos(0) (2) 
z = /sinh(A)sin(^)sin(0) 

15 where (A,/i,0)are the radial, longitudinal and circumferential co-ordinates of the 
polar system and (x, y, z) are the corresponding rectangular cartesian co-ordinates. 
The focal length f of the polate system is preferably chosen so that the A = 1 surface 
gives a good initial approximation of the left ventricular epicardial surface, providing 
an overall scale factor for the ventricle. 

20 

Previously defined points are used to determine the initial position of the model with 
respect to the images. These are: 

a) the location of the central axis at the center of the LV in an apical short axis 
25 image 

b) the location of the central axis at the center of the LV in a basal short axis image 

c) the approximate centroid of the right ventricle 

d) a set of points describing the mitral valve plane. 

30 A model-based coordinate system is then constructed with the origin placed on the 
central axis of the LV one third of the distance from the base to the apex. Nodes are 
placed at equally spaced intervals in the two angular coordinates (fi, 9) and at a 
constant radial coordinate (X), The centroid of the RV has 9=0 and the extent of the 
model in the \i direction is governed by the basal margin points. The distance from 
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apex to base is used to determine the focal length of the prolate system and provides 
an overall scale factor for the LV. 

Each guide point is projected onto the model along lines of constant jO, and 0 and only 
5 the X field is fitted by linear least squares. 

As shown at 1 1 8 in Figure 1 , the next step is to define one or more guide points on 
one or more sHces for which the spatial positions have been defined. Referring to 
Figure 7 the user is presented with the option indicated at 38 of defining guide 

10 points. The user then selects and displays in panel 22 any one of the shces stored in 
the memory. The image of the subject organ is displayed in panel 22. A 
representation of the reference model is preferably superimposed on the image of the 
subject organ. In the preferred form, a representation of the intersection of the 
reference model with the image slice superimposed on the image slice, as indicated 

15 by contour lines 39 A and 39B. 

The user first selects the active surface which is being defined as indicated at 40. In 
Figure 8 the user has selected the left ventricular endocardial boundary as the active 
surface. Using a mouse, the user defines one or more boundary guide points on the 

20 selected slice by clicking in panel 22. These guide points, in combination with the 
reference model, define the endocardial or epicardial boundaries of the heart. 
Preferably three to four endocardial boundary guide points and three to four 
epicardial boundary guide points are entered for each slice, although the user is able 
to enter a large number of boundary guide points for a particular slice or may 

25 instead ignore a slice and enter no boundary guide points for it. 

As the user defines the guide points, the system converts these guide points to three- 
dimensional coordinates from the image position in space for each boundary guide 
point, and fits the model by forcing the model to adhere closely to the guide points, 
30 as will be discussed below. 

Where a number of image frames are stored in memory, the user may advance to the 
next frame by clicking on the Next Frame option indicated at 43. 

35 Figures 9 and 10 further illustrate the process by which the boundary points are 
defined by the user. The user is defining the endocardial boundary of an image slice 
different to the one shown in Figure 7. In Figures 9 and 10 the user is defining the 
epicardial and endocardial boundaries respectively for a further image. 
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It will be appreciated that where an organ other than the left ventricle is to be 
modelled J the reference model will be varied. For example, where the invention is 
used to model the right ventricle, lung and/ or kidney, a different reference model will 
5 be defined. 

The next step indicated at 120 in Figure 1 is to form an estimate model by fitting the 
reference model to the guide points. This process could be initiated automatically 
whenever the user selects the Next Frame option indicated at 43 in Figures 7 to 10, 
10 or may be updated automatically in real time with the insertion or deletion of a guide 
point or any change in guide point position. 

The preferred method for incorporating the reference model data is to minimise an 
error function consisting of the sum of a smoothing term and a term penalising the 
15 distance between each boundary guide point and the corresponding reference model 
position. 

The preferred smoothing term penalises changes in slope and curvature around the 
left ventricle, aUowing the reference model to realistically interpolate guide point data 
20 where the data is sparse. 

The preferred penalty is introduced into the least squares method which penalises 
only the sum of the squared deviations from the boundary guide points to the 
reference model surface. In particular, the first and second derivatives of the 
25 surfaces are constrained to be minimised within the least squares fit to prevent 
rippling and other abnormalities. In this sense, the smoothing can be viewed as 
weighting the estimate model more toward the reference model than the boundary 
guide points so that the reference model is imposed more strongly where there are no 
or insufficient boundary guide points. 

30 

One preferred smoothing method is set out more particularly below, in which 
the error function minimised is: 

E^S(X) + l{Xi^g)-xJ (3) 

8 

35 where Ag are the positions of the guide point data and A(<^^) are the model positions 
at element co-ordinates corresponding to X^ . The element co-ordinates are 
preferably found by projecting the guide data onto the model along lines of constant 
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jl and© . S(A,) denotes a smoothing term included in the error function to constrain 
the model to smoothly interpolate between the sparse guide points. 

S(A,) is preferably a weighted Sobolev norm which penalizes the displacement of the 
5 estimate model from the reference model. 



du 







2 


+ 71 




+ 72 



du 
u 



+ A 



+ 73 



u 

' d^u ' 



(4) 



10 where \x = X - %* where A,* is the reference model. The weights ai and a2 penalize the 
slope of the displacement field in the circumferential and longitudinal directions 
respectively, the weights fli and ^2 penalize curvature and the weights yi, 72 and 73 
couple slopes between directions. Typical smoothing weights are ai = a2 = 0, [3i = p2 = 
0.001, 71 = 72 = 73 = 0.01. 

15 

The resulting estimate model incorporates endocardial and epicardial boundary 
guide points, the long axis of the left ventricle, reference model data and smoothing 
constraints to produce endocardial and epicardial left ventricular surfaces in three or 
four dimensions closely approximating the true surfaces represented in the images. 

20 

Having defined these surfaces, the software may then calculate the intersection of 
the image slices with the surfaces and display the estimate model as indicated at 122 
in Figure 1. The intersections are each represented by two lines, one line 
representing the endocardium and the other line representing the epicardium which 
25 are close to the edges on the images. 

Having calculated endocardial and epicardial surface boundaries on each image, 
image (s) are then evaluated, preferably by the user, for acceptable contours as 
indicated at 124 and acceptable image quality as indicated at 126. The software may 
30 then perform local image processing as indicated at 128 to further improve the 
quality of the left ventricle boundary edges displayed in the images. The use of local 
image processing is not essential to the invention. Where provided, it may be 
invoked by the user. An edge is characterized by an abrupt change in intensity 
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indicating a boundary, and is called a discontinuity. In general an edge is often seen 
as a slow change in grey level values between connected pixels. While a boundary 
edge may be readily apparent to the human eye, it can be difficult for software to 
detect. 

5 

Prior art methods of detecting discontinuities or edges include running a mask or 
window over the image, or by appl3?ing a known edge enhancing filter such as a 
Roberts, Sobel or Laplacian operator. Applying such a filter to an entire image in 
order to find boundary edges is computationally expensive. 

10 

Using the present invention, the endocardial and epicardiai boundaries have been 
estimated with the estimate model. The software therefore can calculate the likely 
position of a boundary edge in an image. An a priori technique may then be applied 
to guide the search for the boundary in the image. 

15 

In one method, radial Hnes may be drawn extending through both the endocardial 
and epicardiai boundaries. An edge filter may be applied at the intersection of these 
boundaries and the radial line to determine the points on the radial Hne most likely 
to represent the endocardial and epicardiai edges. 

20 

Further local processing could also include thresholding, for example grey-scale 
thresholding. AH pixel values falling between two threshold values Ti and T2 retain 
their grey-scale values but all pixel values outside this interval are set to zero. Such 
multiple thresholds may be appUed to reduce the number of grey-level values in an 
25 image, thereby enhancing the contrast. Thresholding may be appHed, for example, to 
contrast the area in the image inside the endocardial boundary, from the area 
between the endocardial and epicardiai boundaries, and/ or the area outside the 
epicardiai boundary. 

30 Local image processing and thresholding as described above may generate additional 
data points which may be added to the existing boundary guide points. The estimate 
model contour may then be redefined based on the additional data points so that the 
relationship to the actual images is improved. 

35 The additional data points obtained from local image processing and thresholding 
may be assigned less weight than boundary guide points selected by the user, as it 
will be appreciated that these additional data points may be less reliable than those 
selected by the user. The generated data points may be displayed to the user in 
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order to identify where additional guide points are needed to improve the estimate 
modelj for example, where a contour has missed the actual edge. 

It will be appreciated that where image processing is performed, it is performed at a 
5 local level. It is assumed that the edge is in a particular region. Image processing is 
computationally expensive and in the past has been performed on an entire image or 
slice. Using the invention, it is possible to determine the approximate position of the 
region so that image processing can be concentrated on that region, significantly 
reducing the processing time. Where the local image processing is unable to 
10 determine the location of an edge, the estimate model wiU be determined primarily 
from the guide points defined by the user, the reference model, and smoothing 
parameters - 

The software may then define the final estimate model surfaces from the finite 
15 element modelling process, with the inclusion of data points obtained by local image 
processing. The intersection of this surface with the image slices permits the 
software to display on the original images the left ventricular endocardial and 
epicardial boundary walls. The step of drawing the estimate model is indicated in 
Figure 1 at 122. 

20 

The number of guide points can be reduced substantially if the images are of good 
quality and the image processing is able to accurately define the edges and guide the 
estimate model on to them. 

25 As shown ia Figure 2, the main window presents to the user the option of viewing the 
images in three dimensions, indicated at 54. On selecting this option the user is 
presented with a 3D viewer window as wiU be more particularly described with 
reference to Figures 11 and 12. 

30 Referring to Figure 1 1, the window includes panel 56 in which images are displayed. 
The user has the option of selecting image planes as the desired view as indicated at 
124. Where the Image planes option is selected, the user may select which image 
slices to display in panel 56. In Figure 11 the user has selected the long axis sHce 
and the fifth short axis sHce to display in panel 56, Also displayed in panel 56 are the 

35 intersections of the estimate model with the original image planes. 



M IIUHPIIMHIM 



172770 14 

Referring to Figure 12, the user has elected not to display image planes. The image 
displayed in panel 56 is instead the estimate endocardial surface rather than 
individual image planes, 

5 Each boundary or contour is then assessed by the user for appropriateness. If the 
boundary or contour is unacceptable, the user may define further boundary guide 
points until such time as the boundary or contour is acceptable, as indicated in 
Figure 1 at 124. 

10 Left ventricular cardiac volume, for example, may then be estimated by calculating 
the volume bounded by the estimate model in the step indicated at 130 in Figure 1. 
Left ventricular wall thickness may also be calculated from the estimate model. Left 
ventricular mass may be calculated from the difference between the volumes 
enclosed by the endocardial and epicardial contours multiplied by an appropriate 

15 constant, for example 1.05 g/ml. 

It will be appreciated that the volume, wall thickness and mass of the right ventricle 
may also be calculated in the same way. Where more than one frame is stored in the 
memory, the method may be used to measure abnormalities in the left or right 
20 ventricle identified through changes in wall thickness over time. The system may 
also be arranged to calculate area, curvature, angles and other parameters from the 
estimate model. 

The method and system of the invention may further provide the results of 
25 measurement and analysis in an intuitive, useful and interactive way that the 
cardiologist can understand and use in patient management. Referring to Figure 13, 
the system may display to a user the volumes of blood or muscle associated with 
each imaging slice. These volumes are preferably determined by calculating the area 
of the endocardium or epicardium from the estimate model for each sKce and 
30 multiplying each area by the slice thickness. 

Individual sHce identifiers are indicated at 80 in a display panel. By cHcking in the 
appropriate box adjacent a sKce identifier the user may view a graph indicated at 82 
of volume vs time for the mass, endocardium or epicardium respectively. Individual 
35 boxes indicated at 84 may display numerical values for end-diastolic and end- 
systolic volumes, mass, stroke volume and ejection fraction for each slice. 
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Figure 14 illustrates display of data similar to the data of Figure 13. In Figure 14 
regions or sections of the ventricle are displayed according to the standard 
definitions of the American Society of Echo car diographers. The data displayed in 
Figure 14 is useful to a cardiologist as the data is independent of the original scan 
5 planes. The data has been acquired by mathematically sampling the model in each 
of the regions. 

Figure 15 illustrates a further display in which the left ventricle has been folded out 
onto a flat surface and the wall thickness at every point mapped in a different colour 
10 or shade. This display cines through the cardiac cycle as wall thickness changes. 
Arbitrary user defined regions can be drawn onto the map and the results shown as 
a graph, for example regions A, B and C in Figure 14. The right ventricle insertion 
with the left ventricle is shown by the dots in the image of the left ventricle. Further 
buttons on the display switch different parts of the display on and off. 

15 

The method may also be used to measure characteristics of other organs for example 
the lung, the kidney or may be used to measure the wall of a blood vessel. In the 
case of a kidney the method may be used to measure cortical thickness. 

20 In a further form the invention could be implemented on or associated with scanning 
apparatus. As the scanner produces images, an operator could insert guide points 
and update the estimate model. Areas of insufficient data could be identified 
automatically and the scanner directed to scan these planes automatically. 

25 The method and system of the invention are particularly suited to measuring 
characteristics of human subjects. It will be appreciated that the same method and 
system could be used to measure characteristics of organs of other mammals for 
example rodents, canines and primates. The same technique could also be applied 
to the task of measuring the size and/ or geometry of a cell. 

30 

The foregoing describes the invention including preferred forms thereof. Alterations 
and modifications as will be obvious to those skilled in the art are intended to be 
incorporated within the scope hereof as defined by the accompanying claims. 
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CLAIMS 

1 . A method of measuring characteristics of an organ or part multiple 
images of the organ or part thereof, the method comprising the steps of 

defining the spatial position of at least two of the images; 

defining a reference model of the organ or part thereof scaled the distance 
between reference markers on the images; 

defining one or more boundary guide points associated with images for which 
the spatial positions have been defined; 

converting the guide points to three-dimensional coordinates; 

defining an estimate model by fitting the reference model to the guide points; 

and 

calculating the characteristics from the estimate model. 

2. A method as claimed in claim 1 wherein the distance between the 
reference markers is calculated by the steps of defining a point on each of two images; 
defining a reference line in 3-dimensional space between the points; and calculating the 
distance as a function of the length of the reference line. 

3. A method as claimed in claim 2 wherein the reference model comprises 
a mathematically defined reference model defined in a polar coordinate system. 

4. A method as claimed in claim 3 wherein the reference model comprises 
an ellipsoid having the reference line as a central axis and one or more surface points, 
each surface point specified by a radial distance from the central axis. 
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5. A method as claimed in any one of the preceding claims comprising the 
steps of displaying one or more images to a user and superimposing on the image a 
representation of the intersection of the reference model with the image. 

6. A method as claimed in claim 5 further comprising the step of 
performing image processing on one or more of the images. 

7. A method as claimed in claim 5 or claim 6 wherein the user performs the 
step of defining one or more boundary points on the image(s). 

8. A method as claimed in any one of the preceding claims further 
comprising the step of calculating the volume of the subject organ or part from the 
estimate model. 

9. A method as claimed in any one of the preceding claims further 
comprising the step of calculating the mass of the subject organ or part from the 
estimate model, 

10. A method as claimed in any one of the preceding claims wherein the 
subject organ comprises a ventricle of the heart and the characteristics measured include 
ventricular mass, endocardial volume and/or wall thickness of all of the ventricle or part 
thereof. 

11. A method as claimed in any one of the preceding claims wherein the 
subject organ comprises a ventricle of the heart and the characteristics measured include 
ventricular abnormalities identified through changes in wall thickness over time. 
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12. A method as claimed in any one of claims 1 to 9 wherein the subject 
organ comprises a kidney and the characteristics measured include cortical thickness. 

13. A system for measuring characteristics of an organ or part thereof of a 
subject from multiple images of the subject's organ or part thereof, the system 
comprising: 

a memory in which is stored the spatial position of at least two of the images; 

reference model definition means arranged to define a reference model of the 
organ or part thereof scaled according to the distance between the reference markers on 
the images; 

boundary guide point definition means arranged to define one or more boundary 
guide points associated with one or more images for which the spatial positions are 
stored in the memory; 

conversion means arranged to convert the guide points to three-dimensional 
coordinates; 

estimate model definition means arranged to define an estimate model by fitting 
the reference model to the guide points; and 

calculation means arranged to calculate the characteristics from the estimate 

model, 

14. A system as claimed in claim 13 wherein the reference model definition 
means is arranged to calculate the distance between the reference markers by the steps 
of defining a point on each of two images; defining a reference line in 3 -dimensional 
space between the points; and calculating the distance as a function of the length of the 
reference line. 
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15. A system as claimed in claim 14 wherein the reference model comprises 
a finite element model defined in a polar coordinate system. 

16. A system as claimed in claim 15 wherein the reference model comprises 
an ellipsoid having the reference line as a central axis and one or more surface points, 
each surface point specified by a radial distance from the central axis, 

17. A system as claimed in any one of claims 13 to 16 further comprising 
display means arranged to display one or more images to a user and to superimpose on 
the image a representation of the intersection of the reference model with the image 
slice. 

18. A system as claimed in claim 17 further comprising image processing 
means arranged to perform image processing on one or more of the images. 

19. A system as claimed in claim 17 or claim 18 wherein the boundary guide 
point definition means is arranged to obtain preferred guide point positions from a user. 

20. A system as claimed in any one of cliams 13 to 19 further comprising 
volume calculation means arranged to calculate the volume of the suject organ or part 
from the estimate model. 

21. A system as claimed in any one of cliams 13 to 20 further comprising 
mass calculation means arranged to calculate the mass of the subject organ or part from 
the stimate model. 
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22. A system as claimed in any one of cliams 13 to 21 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular mass, endocardial volume and/or wall thickness of all of the ventricle or part 
thereof. 

23. A system as claimed in any one of claims 13 to 22 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular abnormalities identified through changes in wall thickness over time. 

24. A system as claimed in any one of claims 13 to 21 wherein the subject 
organ comprises a kidney and the characteristics measured include cortical thickness. 

25. A computer program for measuring chai'acteristics of an organ or part 
thereof of a subject from multiple images of the subject's organ or part thereof, the 
program comprising: 

storage means arranged to store the spatial position of at least two of the images; 

reference model definition means arranged to define a reference model of the 
organ or part thereof scaled according to the distance between the reference markers on 
the images; 

boundary guide point definition means arranged to define one or more boundary 
guide points associated with one or more images for which the spatial positions are 
stored in the memory; 

conversion means arranged to convert the guide points to three-dimensional 
coordinates; 

estimate model definition means arranged to define an estimate model by fitting 
the reference model to the guide points; and 
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calculation means arranged to calculate the characteristics from the estimate 

model. 

26. A program as claimed in claim 25 wherein the reference model 
definition means is arranged to calculate the distance between the images by the steps of 
defining a point on each of two images; defining a reference line in 3 -dimensional space 
between the points; and calculating the distance as a function of the length of the 
reference line, 

27. A program as claimed in claim 26 wherein the reference model 
comprises a finite element model defined in a polar coordinate system. 

28. A program as claimed in claim 27 wherein the reference model 
comprises an ellipsoid having the reference line as a central axis and one or more 
surface points, each surface point specified by a radial distance from the central axis. 

29. A program as claimed in any one of claims 25 to 28 further comprising 
display means arranged to display one or more images to a user and to superimpose on 
the image a representation of the intersection of the reference model with the image. 

30. A program as claimed in claim 29 further comprising image processing 
means arranged to perform image processing on one or more of the images. 

31. A program as claimed in claim or claim 30 wherein the boundary guide 
point definition means is arranged to obtain preferred guide point positions from a user. 
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32. A program as claimed in any one of claims 25 to 31 further comprising 
volume calculation means arranged to calculate the volume of the subject organ or part 
from the estimate model. 

33. A program as claimed in any one of cliams 25 to 32 further comprising 
mass calculation means arranged to calculate the mass of the subject organ or part from 
the estimate model. 

34. A program as claimed in any one of claims 25 to 33 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular mass, endocardial volume and! or wall thickness of all of the ventricle or 
part thereof. 

35. A program as claimed in any one of claims 25 to 34 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular abnormalities identified through changes in wall thickness over time. 

36. A program as claimed in any one of cliams 25 to 33 wherein the subject 
organ comprises a kidney and the characteristics measured include cortical thickness. 

37. A computer program as claimed in any one of claims 25 to 35 embodied 
on a computer readable medium. 
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ABSTRACT 



The invention provides a method of measuring characteristics of an organ or part 
thereof from multiple images of the organ or part thereof, the method comprising the 
steps of defining the spatial position of at least two of the images; defining a 
reference model of the organ or part thereof scaled according to the distance between 
reference markers on the images; defining one or more boundary guide points 
associated with one or more images for which the spatial positions have been 
defined; converting the guide points to three-dimensional coordinates; defining an 
estimate model by fitting the reference model to the guide points; and calculating the 
characteristics from the estimate model. The invention also provides a system and a 
computer program for measuring characteristics of an organ or part thereof of a 
subject from multiple images of the subject's organ or part thereof. 
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